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Abstract 

We propose a change detection method for the famous Cox-Ingersoll-Ross model. 
This model is widely used in financial mathematics and therefore detecting a change in 
its parameters is of crucial importance. We develop one- and two-sided testing proce¬ 
dures for both drift parameters of the process. The test process is based on estimators 
that are motivated by the discrete time least-squares estimators, and its asymptotic 
distribution under the no-change hypothesis is that of a Brownian bridge. We prove 
the asymptotic weak consistence of the test, and derive the asymptotic properties of 
the change-point estimator under the alternative hypothesis of change at one point in 
time. 


1 Introduction 

We consider the well-known Cox-Ingersoll-Ross (CIR) model 

(1.1) dXt = {a-bXt)dt + a^/YtdWt, t > 0, 

where a>0, 6>0, a>0 and {Wt)t^Q is a standard Wiener process. We will be interested 
in detecting a change in the parameters a and b, and for brevity we will use 6 := (a,&)^. 
The volatility parameter a will not be estimated because we work with a continuous sample, 
from which (and indeed, from an arbitrarily small part of which) a can be calculated exactly, 
see Barczy and Pap (2013, Remark 2.6). Therefore change detection in a is not necessary 
- we can calculate, without any uncertainty, whether a is constant across our sample. The 
constraints on the parameter values ensure the ergodic behavior of our process - for details 
see Theorem 2.2 below. These constraints also ensure that any solution of (1.1) starting 
from a nonnegative value stays nonnegative indehnitely almost surely - see Proposition 2.1. 

The process was proposed as an interest rate model by Cox et ah (1985) and is one 
of the standard ’’short rate” models in hnancial mathematics. The statistical properties 
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of the model have therefore been extensively studied: Overbeck (1998) provided estimators 
based on continuous-time observations, while the low-frequency discrete-time CLS estimators 
were proposed by Overbeck and Ryden (1997). High-frequency estimators were proposed by 
Ben Alaya and Kebaier (2012, 2013), whose results we will require occasionally. 

There are a handful of change detection tests for the CIR process in the literature: 
Schmid and Tzotchev (2004) used control charts and a sequential method (i.e., an online 
procedure, which is in contrast to our offline one, where we assume the full sample to be 
known before starting investigations). They also supposed noisy observations, which will 
not be our interest. Guo and Hardle (2010) used the local parameter approach based on 
approximate maximum likelihood estimates. In essence, they wanted to hnd the largest 
interval for which the sample hts the model. Also, they used a discrete sample, whereas we 
will use a continuous one. The main result of our paper is that we were able to prove some 
asymptotic properties of the testing procedure under the alternative hypothesis as well as the 
null hypothesis. We believe this to be important because, if investigated only under the null 
hypothesis, a change-detection procedure is essentially a model-htting test, and results under 
the alternative are necessary to verify its use for the more special task of change detection. 

The statistical problem we are concerned with is the following: we would like to test the 
null hypothesis 

Hq : {Xt)t£[o,T] is the path of a CIR process 
against the alternative hypothesis 

Ha : 3r G [0,T] :(A'i) 4 g[o,r] is a CIR process with parameters a = a', b = b', and 

t£[T,T] is a CIR process with parameters a = a”, b = b". 

In general, we will be interested in asymptotic results as T ^ cx). Under Ha we will also 
require r = pT with p G (0,1). 

The layout of the paper is the following: in the remainder of the present Section 1 we 
will explain our notations. Section 2 will deal with the basic hnite-sample and asymptotic 
properties of the CIR process and establishes the tools for our proofs. We will introduce our 
parameter estimators in Section 3 and derive their strong consistency. We will not investigate 
them in more detail than necessary since we will only use them to construct the test process, 
and we are more interested in their nice algebraic form than their statistical properties. 
We construct our test process and describe the test procedures in Section 4, where we also 
obtain the asymptotic distribution of the test process under Hq. Section 5 contains the hrst 
of our two asymptotic results - namely, the weak consistence of the test. The second result, 
which concerns the properties of the change-point estimator under Ha, is stated and proved 
in Section 6. Section 7 explains how to modify the proofs in order to detect a change in b. 
Finally, the lemmata necessary for the proofs of the main theorems have been collected into 
Section 8. 
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1.1 Notations 


In the following we describe our basic notations. Let N, Z+, M, M+ and M++ denote 
the sets of positive integers, non-negative integers, real numbers, non-negative real numbers 
and positive real numbers, respectively. For x,y eM., we will use x A y := and 

xW y := ma.x{x,y). By ||a:|| and HAH we denote the Euclidean norm of a vector x eM.'^ 
and the induced matrix norm of a matrix A E respectively. We will use asymptotic 

notation for rates of convergence: f(t) = 0(g(t)) means that limsup^^,^ ^ < co. Similarly, 
for a stochastic process Xt, the notation Xt = Op(g(t)) means that the collection of measures 
£ tight for some tg E M+. Unless otherwise noted, asymptotic statements are 

ip) g 

to be understood as T —)■ oo. Following the usual conventions, —>, —> and —4 will 
denote convergence in probability, in distribution and almost surely, respectively. 


As for the probabilistic setup, will always be a hltered probability 

space satisfying the usual conditions, i.e., P) is complete, the hltration is 

right-continuous and Xq contains all the P-null sets in X. We will repetadly work with 
continous martingales; as usual, their quadratic variation will be denoted by {•). 


2 Preliminaries 

In our hrst proposition we recall some well-known properties of the solution of (1.1). 

2.1 Proposition. For any random variable ^ independent of (Wt)tm+ o,nd satisfying 
P(^ G M+) = 1, there is a (pathwise) unique strong solution (W)teK+ of the SDE (1.1) with 
Xq = Further, we have P(Xi E M+ for all t E M+) = 1 and the following equalities: 

(2.1) Xt = e“^* ® y du + a J e^“\/AudIFu^ , t E M+, 

(2.2) X^ = e-2“x2 + [ e-2^(*-“i(2a + a^)Xu du + 2a [ dIU„, t E M+. 

Jo Jo 

The conditional distribution of Xt on Xg, where s <t, is noncentral chi-squared and we have 

(2.3) sup lE(A')’) < oc 

for all T] > 0. 

Proof. By a theorem due to Yamada and Watanabe (see, e.g., Karatzas and Shreve, 1991, 
Proposition 5.2.13), the strong uniqueness holds for (1.1). By Ikeda and Watanabe (1989, 
Example V.8.2, page 221), there is a (pathwise) unique non-negative strong solution {Xt)t£R+ 
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of (1.1) with any initial value ^ independent of (hhi)tGK+ and satisfying P(^ G M+) = 1, 
and we have P(Xt G M+ for all t G M+) = 1. Next, by application of the Ito’s formula for 
the process we obtain 

d(e“Xi) = 6e“Xi dt + e^dX^ = 6e“Xt dt + e“((a - bXt) dt + dWt) 

= ae“dt + ae“V^dhhi 


for all t G M+, which implies (2.1). 

The noncentral chi-squared distribution is a well-known property of the process, and it 
can be found in the paper of Feller (1951). The property (2.3) is a direct consequence of this 
fact and the calculations can be found, e.g., in Ben Alaya and Kebaier (2013, Proposition 
3). □ 

The following result states the existence of a unique stationary distribution and the 
ergodicity of the CIR process. The proof can be put together from Feller (1951), Cox et ah 
(1985, Equation 20), and Jin et al. (2013). 


2.2 Theorem. Let a,b,a G M++. Let (Xt)tgR^ be a strong solution of (1.1) with 
P(Xo G M+) = 1. Then 


T) 

(i) Xt —> Xoo as t ^ oo, and the distribution of X^o is given by 

2 \ -2alu'^ 


(2.4) 


E(e-“")= I 1 + -A 


cr 


A G 


^-1-) 


i.e., Xoo has Gamma distribution with parameters and Tbja^, hence 


E(X“) = 


(frr(a’ 


2a 

a G ( ) • 


(ii) supposing that the random initial value Xq has the same distribution as X^o, the 
process {Xt)t£R+ is strictly stationary; 

(hi) for all B Orel measurable functions / : M — )■ R such that E(|/(Xoo)|) < cxo, we have 

1 

(2.5) - f{X,)ds^E{f{X^)) asT^oo. 

^ Jo 
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2.3 Corollary. In the setting of Proposition 2.1 we have 


E(Xt) = e-“E(Xo) + a du 


E(X2) = E(X2) + / (2a + a^) ( ^ j ^-b{ 2 t-u-v) j 


Hence, 


Q 0,0^ -\- o‘^(T^ 

(2.6) E(X,) = E(Xo.) = 14m E(X2) = E(X4) = 


moreover, 


(2.7) 


/ |E(X,)-E(X„)|d(<oo, / |E(y^)-E(X^)|d(<oo. 

'0 io 


Proof. The first equalities are straightforward by taking expectations on both sides in 
Proposition 2.1 (we note that the stochastic integrals in question are indeed martingales due 
to (2.3)). From there, (2.6) is a question of elementary calculus: for the hrst equation we 
write 


£—>-cx) 


( 2 . 8 ) lim (e ^*E(Xo) + a / e “Mn) = lima / e dv = a e dn = 


t^OO 


For the second equation we observe 
(2,9) 


t nu 



'0 ^0 
and hence 


bi2t-u-v) ^ (e-2Kt-7x) _ Q-b[2t-u)^ du^ e-2^“dn+ 


^—bt pt 


e-^“ dn 


t—>-oo 


lim ( e-2“ E(X2) + / (2a + a^) ( ^^Xq) + a e-K^t-n-v) 


( 2 . 10 ) 


(2a + cr^) lim ( E(Xo)e / e dm + 

t^OO V Jr. 


JO 

all dn 

Jo Jo 


1 

= {2a + a^)- e-^'^^dw. 

b Jo 


For the hrst part of (2.7) we consider (keeping in mind (2.8)) 


E(Xt)-E(Xo,)| = 


e-“ E(Xo) -a J du 


^ e-“E(Xo) + ar'e-“, 


-l-bt 
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which yields the result immediately. For the second part, we combine (2.9) and (2.10) to 
obtain 


E(X2)-E(X^)| 


e-2^*E(X2) + (2a + a2)e-^' 


(^E(Xo)e-'“ 



du 


1 

b 



du 


^ e-^“ E(Xo") + (2a + a^)e-“ E(Xo) + 


-2bt 


262 


This yields the desired result immediately. □ 

Finally, we recall a strong law of large numbers and a central limit theorem for continuous 
local martingales. 


2.4 Theorem. (Special case of Liptser and Shiryaev, 2001, Lemma 17.4) Let the 

process (Wt)tm+ be a standard Wiener process with respect to the filtration (J^t)teK+- Let 
be a measurable process adapted to {Tt)t£R+ such that 


( 2 . 11 ) F [ ^Idu < oo] = 1, te 


and 



as t ^ oo. 


Then 

( 2 . 12 ) 


fo dWu ^ 


as t ^ oo. 


2.5 Theorem. (Special case of Jacod and Shiryaev, 2003, Corollary VIII.3.24.) 

Let (Xf )teM+ be a series of locally square-integrable continuous martingales such that 





t e M+, 


as n ^ oo. 


Then {X^)tm+ {Wt)teR+, where (lFi)t6R+ 


is a standard Wiener process. 


3 Construction of our parameter estimators 

In this section we will define some estimators for the drift parameters of the CIR process, 
based on continuous time observations. We will do this in the following way: first we 
introduce least squares estimators based on low-frequency discrete time observations, then 
we will introduce our estimators as a formal analogy; we will not try to construct our 
estimators as solutions to a least-squares problem. 
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An LSE of {a,b) based on a discrete time observation can be obtained 

by solving the extremum problem 


n 

(a°,6^) := argmin - (a - hXi_i)f. 

(a,b)eK2 


This is a simple exercise, which has the well-known solution 




n 

-TtrX.-; 

-1 


Q e 



TJ:=rXlr _ 




provided n X‘f_^ - Xi_if > 0. 

By a formal analogy, we introduce the estimator of (a, h) based on a continuous time 
observation (A't)tg[o,r] as 


Qjj^ 


T -srx 

-1 

Xt-X„ 

brp 




-ir.r 


provided T X"^ ds — ^ Xgds'j > 0, which is true a.s. To see this, consider that, by a 
simple application of the Cauchy-Schwarz inequality, 

X^ ds - X, ds 

and equality happens only if X is constant almost everywhere on [0,T]. In particular, since 
X is continuous on [0,T] almost surely, this implies Xq = Xt almost surely. However, since 
the distribution of Xt conditionally on Xq = a: is absolutely continuous by Proposition 2.1, 
P(Xr = Xo|Xo = x) = 0 for all x G M+, which suffices for the statement. 

To condense our notation, we will use 




(3.1) 


Qs = 


Xu du 


- /g Xu du 


and 


do : = 


■f;xudXu 


3.1 Remark. The stochastic integral Xu dXu is observable, since, by Ito’s formula, we 
have d{X^) = 2Xt dXt + u'^Xt df, t G M+, hence 


XudXu 
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Using the SDE (1.1) one can check that 


(3,2) 


Qjrp - Qj 


brp b 


= Q 


-1 


' a J^Xy^dWs 

-a 


provided T X^ ds - (^fJ^X^ds^ > 0, which is, again, true a.s. In further calculations 
we will use 


(3.3) 


d, a 


f^xy^dw^ 

-ffxy^dw^ 


3.2 Theorem. Let (Xt)tm+ be a strong solution of (1.1) with P(Xo G M+) = 1. Then 
the LSE of {a,b) is strongly consistent, i.e., (arp,brp) (a, &) as T —)■ cxo. 

Proof. Recall (3.2) and write 
(3.4) 


r n 

( Qt\ 


’ <72 Jf Xs ds a Jf xy^ dW, ' 

Qjrj^ Qj 

If ds 0-2 ff Xs ds 

b'j' b 

V T J 

T 

-affxy^ dW. 
ds 


Now, the statement is evident from (2.12) and (2.5), noting that 


0-2/q X^ds _ T X^ds a.s. E(Xoo) 


CT' 


T-^a^ gxfds E(Jfi)' 


□ 




4 Construction of the test process 

First we introduce the martingale 

M,:=X,-Xo- / (a-6Xjdu = a / V^dlU,, sG 
Jo Jo 

which satishes 

(4.1) dMs = dX, - (a - bXs) ds = a V^^dlU,. 


Let us fix a time horizon T G M++. The process will again be introduced as a formal 
analogy to the efficient score vector, as is done in Gombay (2008). The analogue of the 



















efficient score vector process at time tT, t G [0,1], will be 



The information contained in a continuous sample {Xu)u£[o,tT] is the quadratic variation of 
the efficient score vector process, namely, 



{M)s ds = cr^ 


r 

1 

1 - 

1 

L 




ds 


=: I 


tT, 


since {M)s = cr'^Xg, s G M+. For each s G M_|_, replacing the parameters by their estimates 
in Mg, we obtain an estimate Mg , i.e.. 



Xg — Xq — / {qt — hxXu) dtt, 
Jo 


s G M+. 


Our test process will be the estimated efficient score vector multiplied by the square root of 
the inverse of the information matrix, i.e.. 




dMf), 


tG [0,1]. 


This process can also be written in CUSUM form 

t G [0,1]. 

Indeed, 



4.1 Theorem. 


Let be a strong solution of (1.1) with P(Xo G 


1. Then 



te[o,i] 





as T ^ oo, 


where {Bt)t£[o,i] is a 2-dimensional standard Brownian bridge. 
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Proof. We have 


rtT 

1 

rtT 

1 

rtT 

1 


1 

dup = 

1 

dM,- 

1 

lo 


Jo 


Jo 



dM, - dMf M , 


and 


rtT 


1 

-X. 


dMs - dMP^ = 


ftT 


1 

-x. 


P — a — {hrp — h)Xs ] ds 





T, 


with the notations from (3.1) and (3.3). In the following, E 2 denotes the 2-dimensional 
identity matrix. From the preceding calculations it follows that, for every t G [0,1], 

mP = (dtT - QtTQr^dPj 

= Irp ^ {ptT - Irp ^ {tE2 - QjrpQrp^^dj' 

= {TIp/^ (dtT - tdr) + ((T-'/r)-'/' - (dtT - tdT) 

+ It ^ {tE2 — QtTQT^)dTi 

where 

[- E(X^) 

It is a simple consequence of the ergodic theorem that T~^It / as T —)■ 00 . Conse¬ 
quently, Theorem 4.1 will follow from 

(4.2) sup {tE 2 — QtrQr^) 0 as T ^ cx), 
and 

(4.3) dP A Wt)i6[o,i] as T ^ cx), 

V /tG[0,l] 

where (Wt)t6[o,i] is a 2-dimensional standard Wiener process. 

We begin by the proof of (4.3). The convergence is a simple consequence of Theorem 2.5. 
dt is a locally square-integrable martingale, therefore we only need to check the pointwise 
convergence of the quadratic variation. Using (iii) from Theorem 2.2 it is easy to show that. 
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for every t G [0,1], 


T 




r 

■ X, -xf 

ds t 

’ E(Xoo) 

- E(XJ.)' 

h 


-E(X^) 

E(V^) . 


= t/, as T —)■ oo. 


For (4.2), introduce 

1 -nxoo) 

E(^o„) E(Xi) _ 

and note that due to Theorem 2.2 we have T' ^ Q Now, hrst observe that 


Q = 


Qt QtT 


r-H 

1 

T tT 


\T J 


\\tE 2 — QitQt^W ^ t 


For this transformation to be sensible, we needed to extend ^ continuously to s = 0, but 
this can be done since all components of ^ has a hnite upper limit at 0 almost surely (i.e., 
the powers of Xq). Since the last factor converges to ||Q~^|| almost surely, for (4.2) it is 
sufficient to show that 


(4.4) 


sup t 


Qt _ QtT 

T tT 


0 . 


In order to exploit the almost sure convergence of we note that 


Qj, a.s 


^ Q implies 


sup,>T 

introduce 


Qs 


-Q 


0 as T —)■ cxo and thus sup^^^. 

Qs 


Qs 


Q 


0 as T —)■ cxo. Now let us 


K := sup 

s^O 


This limit is hnite almost surely since ^ is continuous on M+ and has a hnite limit at inhnity 
almost surely. Now we observe, for an arbitrary e > 0, 

Qt QtT 


P ( sup t 


^ P sup t 


> e 


tT 

Qt QtT 


tT 


^p(^ 2A'>.)+P sup_(i 


> e I + P I sup t 

Qt 


Qt _ QtT 

~T~ IT 


> e 


T 


-Q 


Q 


tT 


tT 


-Q 


> e 


^ 0 + P 


^-Q 


.4K 


^-Q 

s 


>1 
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Dividing the last probability according to the value of K, we have 



+ > Vt) 



All three terms in the last expression tend to zero as T —)■ oo, therefore (4.2) is proved. □ 

4.1 Testing procedures 

Based on Theorem 4.1, we can develop the following tests with a significance level of a: 
Test 1 (one-sided): if it is clear that, in case of a change, a' < a", reject Hq if the minimum 

of ^)te[o,r] is greater than C'i(a!), where C'i(a) can be obtained from the distribution of 

the minimum of a standard Brownian bridge. The same test can be applied to the maximum 

-—' ( 2 ) 

(for a' > a") and to [M-t )te[o,r] (for a change in h). 

— ( 1 ) 

Test 2 (two-sided): reject Hq if the maximum of |Alj |tG[o,T] is greater than C 2 {a)^ where 

C 2 {(y) can be obtained from the distribution of the maximum of the absolute value of standard 

-—- ( 2 ) 

Brownian bridge. The same test can be applied to |te[o,T] (for a change in b). 

Naturally, the test for a and b can be applied simultaneously, in which case the significance 
levels for the individual tests have to be modified accordingly, in order to produce an overall 
signihcance level of a. 


5 Asymptotic consistence of the test 

Before stating our results under the alternative hypothesis, we need to examine the ergodicity 
results that we can use more closely. Let us take two parameter vectors: 6 ' and 6 ” (in the 
formulation of the theorem, 6 ' = (o', b)^ and 6 ” = (a", 6)^, but for the time being, we can 
work more generally). Furthermore, we take two random variables, X'^ and X'^, such that 
they are distributed according to the stationary distributions corresponding to 6 ' and 9 ”, 
respectively. Let us take a process {Xt)tm+ such that it evolves according to (1.1) with 
parameters 6' until t = pT and with parameters 0" thereafter. We would like to apply the 
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ergodic theorem (i.e., Theorem 2.2) separately to the process before and after the change- 
point (i.e., pT). However, we cannot do this directly for the second part because the initial 
distribution may depend on T. However, we do have 


(5.1) 


1 


T- pT 


g{X,) dt^E(^7(X")), 


'pT 


where g : M+ —?■ M with E(| 5 f(X)|) < oo. Indeed, for an arbitrary e: > 0 


P 


T-pT 


g{Xt)dt-E{g{X")) 


'pT 




T- pT 


g{Xt) dt-Eig{X")) 


IpT 


> e 



dPf (x) 


< 


pf - p* 



T-pT 


g{X,)dt-E{g{X")) 


IpT 


> e 



dP*{x), 


where P* is the distribution of X', P^ is the distribution of XpT and H-H is the total 
variation norm. The hrst term converges to zero because the CIR process is positive Harris 
recurrent (Jin et al., 2013, Theorem 2.5). This implies ergodicity by Meyn and Tweedie 
(1993, Theorem 6.1), since in this case the 1-skeleton (i.e., the process {Xi)i^x+) is clearly 
irreducible because the support of the distribution of Xi conditionally on Xq is M+. In the 
second term the measure is hnite, while the integrand is bounded by 1 and converges to 
zero pointwise, therefore (5.1) is proved by the Lebesgue Dominated Convergence Theorem. 
The same line of reasoning can be used to apply Theorem 2.4 (with weak convergence) and 
Theorem 2.5 after the point of change. Let us now introduce 


d[a,b] • 


huv.' 

-px.dx. 


Q[a,b] 


1 ds — Xs ds 

J a Ja ^ 

-f^'Xsds [’'X^ds 

Ja ” J a s 


With these notations, 

9t = {Q[0,t] + Q[t,T]) (^[0,r] + d[r^T])- 

With the help of the ergodic theorem, we can see that this quantity has a hnite weak limit: 


e := 


:= ipQ' + (1 - p)Q")-' ipQ'O' + (1 - p)Q"0") , 


where 


Q' ■■= 


1 -E(X; 

E((v 




Q" = 


1 -E(X") 

■E{X':,) E((X. 


"■, 2 ) 

ooJ / 
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5.1 Theorem. If a changes from a' > 0 to a" > 0 ai time r = pT, where p G (0,1), then 
for any 7 G (O, we have 

sup mP =T%1^ + Op(Ti-^), 

with Ip = {a' — a'')lj{{pQ'p + ((1 — Here li = (1, O)"’", the first unit vector. 

5.2 Remark. Note how the sign of the principal term depends on the direction of change: 
it is negative in case of an upwards change and positive in case of a downwards change. This 
gives us the possibility to design one-sided tests. 

Proof. First we show how the estimates behave in this case. Clearly, 

e'-0 = {i- p){pQ' + (1 - p)Q’'pQ'\e' - e"). 


We have 




= Q' 


and hence 

(5.2) {O' -ey 
In the same way we can conclude that 

(5.3) {G" - ey 




1 

•E(X. 


y 

p' 


") 
00/ 




1- p 


Now we apply the following decomposition (which is useful for t < t] for f ^ r it has to be 
modihed in a straightforward manner): 


IdMf) = / ldM„ + 


>0 


{b-b')E{xy + {a'-y 


du 


+ f {bT-b'){Xu-M{Xu))du+ [ \{bT-b)E{Xu) + {a-aT) 
Jo Jo ^ 


du 


(5.4) 


= / ldM„+ / (0'-e) 


T 


•E(X, 


du 


fie'-dy 

0 

du -i- f (0 — oy 

1 

/o 

E(XJ - 

Jo 

-E(XJ_ 


du. 
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This leads to 


sup 

O^t^T 


IdMP - TxIj 


rrAt 




1 


/ + 

/ IdK 

+ sup 

/ {O-Ot) 


du 

Jo 

JrAt 

O^t^T 

Jo 



+ 

/ prAt 

sup / {e'-ey 

1 

du+ [ (e"-6y 

1 

du — Tif 1 


OsgfsCT Wo 

- E(X„)_ 

JrAt 

- E(X„)_ 

J 


+ sup 

O^tsgT 



0 

U ^ ^ 

1 


/ (O' - ey 

h 

E(XJ-X„_ 

du+ {e"-ey 

J rAt 


du 


The first term is Op(T'>' according to Lemma 8.4, the fourth term by Lemma 8.3 and the 
second term by Lemma 8.5. For the third term, we write 


sup 


^ sup 


prAt 

/ (O' - oV 

Jo 

1 

du+ 1 

J 

(6 

rAt 

> 

1 

0 

E(Xo,)-E(Xj 

du 




-E(X„) 


du — T^jJ 


+ sup 

1 - 

1 

du 

+ 

(t At (t - r)+ y\ 
sup T W 

OCKT 

J rAt 

E(Xoo) - E(XO 



O^t^T \ P J ~ P J 


The first two terms in this decomposition are bounded by (2.7) and the last one is obviously 
zero, with the supremum attained at t = r. This completes the proof. □ 


6 Estimation of the change point 

The natural estimate of the change point if a' > a", i.e., when a downward change in a is 
being tested, is 

Tt := inf{f G M+ : = sup 

Clearly, this is a well-defined, finite quantity, since ^ has continuous trajectories almost 
surely. Regarding this estimate, we state the following result: 

6.1 Theorem. Under the asumptions of Theorem 5.1, if a' > a", then we have 

Tt — pT = Op(l). 
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Proof. We remind the reader that, according to the assumptions, r = pT. We need to show 
that 

lim supP(|fT — pT\ ^ K) = 0 a.s., 

K-J-CXJ'TgK 


or, equivalently, 

lim limsupP(|rT — pT\ K) = 0 a.s. 

K^OO 

For this, it is sufficient to show that 


( 6 , 1 ) 


lim lim sup P 


K^oo 


T—>-cx) 


sup 

pT—K<.t<.pT-\-K 


mP < 


sup mP ) = 0 

O^t^pT-K 


and that 


( 6 . 2 ) 


lim lim sup P 

K^oo T^oo 


sup MP ^ 

pT-K<t<pT+K 


sup MP 

pT+Kf^t^T 


= 0 . 


First we prove (6.1). We observe 


P 


sup mP ^ sup mP ) ^ P ( ^ sup mP 

pT—K<.t<.pT-\-K O^t^pT—K ) \ O^t^pT— 


= p 


inf ^ 0^ = P f inf T 

Oi:ti:pT-K / \Ki:ti:pT J pX-t 


?(T)^ 


1 dMP < 0 


We apply the decomposition (5.4) to show that 

rpT 


P ( inf t 

\KfitsipT J pT-t 


-1 


1 dUP < 0 


^ P I inf 

Ks^tsipT 


rpT 


P - d) 


T 


pT—t 


-E(xp 

(6.3) + *“ - AV-.)| S 


ds ^ 




+ P ( sup [ 

yXi^tsipT JpT-t 


+ P ( sup 

K^t^pT 


{O' - e 


T 


pT—t 
rpT 
I pT-t 


0 


E(XP - W 


ds 




p 


(e-Oj 


\T 


-E(XP 


ds 


6 


In the first term we take the probability of a deterministic event, therefore it is either 0 or 
1; we show that for sufficiently large iF, iV it is 0. 
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Actually, this is the same statement in continuous time as Lemma 7.7 in Pap and Szabo 
(2013), and the proof is also the same. First we note that, as has been shown before. 


fit) := ie' - 6) 


t OO. 


For an arbitrary e > 0, let us introduce z/(e) := sup^.y(-j)<^_g < oo. Furthermore, let 

:= inf fit) > —oo. 

Then we have, for a sufficiently large T, 
rpT 


inf t ^ / /(s) ds 

O^t^pT 


/ rp^ I 

^ min ( inf t~^ / /(s)ds,-^ 

Vo=sts:pT-i/(£) ^ pT - z/(e) 

/ , K,ie)iyie) , \ 


K(e)i/(e) + ipT - vie)) inf /(s) 

z/(e)^s^pr 


As —)■ 0 as T ^ oo, we conclude that the second term in (6.3) is 0 for sufficiently 

large T, irrespective of K. 

The fourth term in (6.3) converges to zero as T —)■ oo for any K, as 


sup 

O^t^pT 


npT 

1 




1 




ds 

^ sup 




J pT-t 

-E(X,)_ 


OsJt^pT 


-E(X0_ 



and the right hand side is bounded as T —)■ oo. Meanwhile, 0 — 0^ —)■ 0 a.s., which suffices 
for the fourth term in (6.3). For the third term we use Lemma 8.6 and for the second one 
we can use Lemma 8.4. □ 


7 Detecting a change in b 

In Theorems 5.1 and 6.1 we postulated a change in a. However, this was only done to keep 
the resulting calculations tractable. Straightforward modihcations allow us to prove the 
same results for a change in 5 - following the same thoughts as in 4.1. In this case, we would 
have 

7.1 Theorem. If b changes from h' > f] to h" > f) at time r = pT, where p G (0,1), then 
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for any 7 G (O, we have 


sup [\-X,)dMP =T<P + Op(Ti-^), 

O^t^T Jo 

with (j) = {b' — b")lj{{{1 — p)Q")~^ + {pQ')~^)~^l 2 . Here I 2 = (0,1)"'', the second unit vector. 
In place of (5.4) we have, then, 

[ XudMP= [ X„dM„+ / {b-b')E{Xl) + {a'-a)E{Xu) 


rt r- 


+ 


rt 
10 
u\rv2 


dn 


{br - b')(Xl - E(.Y3) + (a' - a)(Y:„ - e(y:„)) 


du 


(7,1) 


10 


{bT-b)E{Xl) + {a-aT)E{X^ 


du 


= / X„dM„ + {O'- 0) 


T 


-E(X, 


du 


f\o'-dT) 

E{xy-x^' 

du + [ {6 — 6t) 

'-E{xy 

Jo 

- my. 

Jo 

. my. 


dn. 


The second term is approximately 

t{o' -oy 


-nx'y 

mx'Lf) 


= t{0' - eyq' 


= t— 
p 


as in (5.2). From here the proofs proceed as for a change in a, with the only added difficulty 
that we will require (8.2) and as well as (8.1), but the proof of that result is merely a matter 
of algebra. 


8 Details of the proofs 

In this section we detail the necessary lemmata for the proofs of our main theorems. Some 
of them, especially Lemma 8.1, are rather technical and depend essentially on tedious but 
straightforward calculations. Others, while using more sophisticated tools, are also tailored 
to the specific needs of the proofs and their proofs are not particularly insightful themselves, 
hence they were relegated to this section. The one exception to this is Lemma 8.2, which is 
an analogue of Lemma 8.8 and may deserve independent interest. 
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8.1 Lemma. For the model described by (1.1) we have 


( 8 . 1 ) 

and 

( 8 . 2 ) 


Var ( I ) = 0(t), t —)■ cxo, 


Var ( / X^ds ) = 0(t), t ^ oo. 


Proof. For (8.1) we note 

Var X,ds^ ^ ^ ~ ^Xu)du (X^ - EX„)dn^ = jj Coy{Xu, X^)dudv. 

° ° ° [0,t]2 

By using (2.1), we can write 

Cov(X„,X,) = E[(X„ - EXJ(X, - EX,)] = 


(8.3) 


= E 


e-'"(Xo-EXo) + a / ^dlF„ ) 






X • e-'"(Xo - EXo) + a / ^^dlF, 






Var(Xo) + 0 e 

Jo 


—b{u+v—2w) 


E(X„)dw; 


^ ^-b{u+v) Var(Xo) + (E(Xo) + 




Since 


E(X„) = e-'^^ E(Xo) + a / e'^Ms 

Jo 


by (2.1). Furthermore, 


r*UAV 


dndn = 


(8.4) 


[0,t]2 



~ ^—b{u-\-v—2w )" 

JJ 

2b 


[o,t]= 


w=uAv 


dudn 


_ ii;=0 


2b 


—i»|ix—1;| —6(ii+'u)'' 


(e - e 


[0,t]2 


dudn ^ ^ yy e-'’l“-^ldndn = 0{t). 

[0,i]2 
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We combine this with the last line of (8.3) and note that 


(8.5) 


= 0(t), 


[0,t]2 


which completes the proof of (8.1). 

For (8.2) we use the same approach. By (2.2), 

Cov(A-J, X‘i) = E[(.YJ - E{Xl))(X! - E(A';f))] = 


= E 


—2bu 


(X^ - E(Xo) 2) + / (2a + a2)e-'’(2“—)(Xo - E(Xo)) dw 


+ {2a + a^)a 


+CT / 


X ( - E(Xo) 2 ) + j (2a + a^)e-’’^^^-'^\Xo - E(Xo)) du; 

rv rw 

+ {2a + a‘^)a / 


+CT / 

Jo 

= Var(X2) + (2a + I e"^"' dw I e"^"' dw Var(Xo) 

Jo Jo 

^2e-3'^(“+’^)(2a + a2) [ e-'^^ dw f dw Coy{Xo, X^) 


+ (2a + (T^)^(T^ 



E 


0 ^0 


^—b(2u—w—z) 




+ (2a + (T^)(T^ 




/ V / pw _ pu \ 

eU e-^(2^-“'-dywdW4y e-2d“-9)x3/2diyj dw 

r-uAv 

+ / E(X3)dw. 

Jo 
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Proceeding with the calculations, we have 


Cov(X^, Xl) ^ Var(X2) + (2a + Var(Xo) 


+ 2e-"'(“+")(2a + a^)- Cov(Xo, X^) 


u pv pwAr 


+ (2a + 



^—b{2u-\-2v—w—r—2z) 


¥,{Xz)(iz(ir(iw 


10 JO JO 
f*u pwAv 


+ (2a + (T^)cr^ 



^—b{2u+2v—w—3z) ■p/ -y^2 


E(X^)d2:dta 


'0 JO 
cv pwAu 


+ (2a + (T^)cr^ 



^—b{2u-\-2v—w—3z) T|^ / ■y'2 


E{X^)dzdw 


0 JO 


f*uAv 


^—2b{u+v—2w) Tj^/ 


E(V^)d«.. 


Referring to (8.4) and (8.5) we see that we need only concern ourselves about the fourth, 
hfth and sixth terms. For the hfth term, we have, for u < v, 


u pwAv 



-b{2u+2v-w-3z)^^^^ = 


0 Jo 



^_bi2u+2v-n,-3z)^^^^ 

0 ^0 
U 1 

' —b{2u+2v—4w) _ ^—b{2u+2v—w) 

3b" 




'0 


^ /^-2b{v-u) _ -2b{v+u)\ _ -b{u+2v) _ -2b{u+v) 

1262^ ^ 362^'' 


and for u > v, 


u pwAv 



0 ^0 



b^2u+2v-w-0z)^^^^ ^ 


0 JO 


+ 



+ 


f V JO 
1 

l^u ^ 

„ 3b 


-b(2u+2v-w-3z) 


^Q-b{2u+2v-^w) _ ^-b{2u+2v-w)^^^ 


'Q-b(2u-v-w) _ ^-b(2u+2v-w)-<^^^ 


^ /p-2b(“-'») _ p-26(M+i^)'\_fp-^>(2M+-«) _ p-‘ib{u+v)\ 

1252 V® ^ 352 V® ^ 


_|_^ _ Q-2b(u-v) _ ^^-b(u+2v) _ ^-b(2u+v)j'j 

352 
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The same results, with u and v exchanged, hold for the sixth term. All the exponential 
expressions in question can be estimated from above by whence we can invoke (8.4) 

again to conclude that the hfth and sixth terms, integrated over [0,t]^, are 0(t). 

All that remains is the fourth term: for u < n. 


V nv pwAr 



-b{2u+2v-n^-r-2z)^^^^^^ 


0 ^0 ^0 


u rw pr 



^.b{2u+2v-n^-r-2z)^^^^^^ + 


u pr pr 


'0 ^0 ^0 
f'U pw 2 

u pv - 



-b{2u+2v-^-r-2z)^^^^^^ 


0 J w J 0 



0 ^0 


^^-b(2u+2v-w-3r) _ ^-b{2u+2v-w-r)^ drdtC 



0 Jw 


2b 


^Q-b(2u+2v-3w-r) _ ^-b{2u+2v-w-r)^ drdw 


'0 L 


^ ^^—b(2u+2v—4w) _ ^—b{2u+2v—w)'j _ ^ ^^—b(2u+2v—2w) _ ^—b{2u+2v—w)'j 


662 


262 


I ^ f —b{2u+v—3w) _ —b{2u+2v—4:w)\ _ ^ ( —b{2u+v—w) _ —b{2u+2v—2w)\ 

~^Oh2 ^ ) Oh2\*^ ^ ) 


262 


262 


dtc 


^ ^g-26h--!i) _ Q-2b{u+v)^ _^ ^^-b{u+2v) _ ^-2b{u+v)'j 


663 


2463 

1 ^g-2bD _ g-2&(u+'u)^ _|_ ^^-b{u+2v) _ ^-b{2u+2v)^ 


463 

1 

^3 

1 


_|_^ fQ-b{v-u) _ ^-b{2u+v)\ _^ /^-2b{v-u) _ ^-2b{u+v)^ 


^-b(u-\-v) _ -b{2u+v) 


^(<= <= 


1 




—2bv _ —2b{u-\-v) 


). 


and, u and v have to be interchanged for u > n (in this case, we exchange the two outer 
integrals, and from there, the modihcations are trivial). Again, we see that all the exponential 
terms are dominated by which, by invoking (8.4), completes the proof of the lemma, 

noting that suPj^qE(X3) < cx). □ 

The following lemma is an analogue of Lemma 8.8, which is a Hajek-Renyi type inequal¬ 
ity. With Lemma 8.8 one can estimate the tail probabilities of the maximum of a random 
sequence, based solely on the joint moments of the elements and, critically, without the 
assumption of independence. In our applications, not the supremum of a sequence but the 
maximum of a function is considered, so we had to modify the statement accordingly. 

It turns out that the proof can be constructed along the lines of Theorem 4.1 in Kokoszka 
and Leipus (2000). In that paper, a slightly stronger result than Lemma 8.8 was formulated 
and proven; however, it was impractical to use, hence the more useful corollary formulated 
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as Theorem 3.1 in Kokoszka and Leipus (1998), which is obtainable from Theorem 4.1 in 
Kokoszka and Leipus (2000) by a simple application of the Cauchy-Schwarz theorem. 


8.2 Lemma. Let h) be a process with a.s. continuous trajectory, a,l3 & M+ with a < (3 and 
c a deterministic function. Then, for any e > 0, 


e F sup ( c(s) I Yudu ) > e ^ ^ c{a) j IE(F„) du 

sG[a,l3] 


y / ps ps 


+ 



E{YuY^)dudvj d\c{sY\ + 2 j c{sf 




a \J0 J 0 


nrj 



E(y„y);)dMdn 


0 JO 


1/2 


ds 


Proof. For any nonnegative process Zt with a.s. continuous trajectories and a.s. locally 
bounded variation, let be the hrst hitting time of [e, cxo) in [a, oo), A be the event {r^ < (3} 
and Ds be the event ^ e}. Note that Dp = A'". Then it is easy to check that 

fh 

( 8 . 6 ) sIa ^Z^+ IdAZs- 

J OL 


Indeed, if A occurs, the LHS is e, and the RHS is e, A < s and Za if Za ^ £. If A^ 
occurs, the LHS is zero, while the RHS is Zp ^ 0. 


Let us apply this result with Zt = c(tY /q Yg ds 


We take expectations on both sides: 


{ sup 

c(s) / Wdw 


JO 


C E 


c(a)^ / Y^du 


> e 


+ E 


I\da((c{s) j^udu 


= c{aY / E{Y^) dw + E 


2 f In c(s) [ YAu 


I Yuduj dc(s) + c(s)Wcl‘ 


= c(a)2 / E(F,2) du 


E 



YuYAudvj d(c^(s)) + 2 y 1d,c^(s)W j Wdwds 


E 


2^1 


s ps 



Ds \ I I YyYAudv \ d\cAs)\ + 2 / lo^cRs)W / Yududs 

a \J 0^0 / J a Jo 
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In the last step we replaced the induced norm of c^(s) by its total variation norm. Indeed, 
the inequality holds because F^y^dudn = (/^ y^du)^ for every oj in the probability 
space where Y is defined, therefore the integrand is nonnegative. Now, we employ several 
well-known inequalities and the replacement of the indicator function by 1 to obtain our 
statement. □ 

8.3 Lemma. If the parameters a and b remain constant, we have, for any l < \, 

sup t^-^ [ |X„-E(X„)|dn = Op(l). 

O^t^T Jo 


Proof. We will use Lemma 8.2 for the process := Xt — E(Xi) and c(s) = ^ and 

0 = 0, jJ = T. Then we can use Lemma 8.1 to conclude that 


E(WW) dvdu= / Cov(X„, Xy) dn du ^ ns, s G M+, 

Jq Jo 



0 JO 


for some constant k > 0. Hence, in this case. 



>0 \Jo Jo 

rT 
'0 


c{sf 





E{YuY^)dudv 


0 Jo 


1/2 


ds 


EiYuY^)dudvj d|c(s)2| +2 
^ / K{2-2-i)s^^-‘^ds + 2 [ s‘^^-\KksY/^ ds 

Jo Jo 

= k{ 2 — 2'y) f ds -I- 2{KkY^‘^ f ds < oo. 

Jo Jo 

This implies the desired statement immediately. □ 

8.4 Lemma. If the parameters a and b remain constant, we have, for any 7 < 

sup = Op(l). 

o^tsgr 


Proof. First we note that has an a.s. continuous trajectory on R_|_, therefore also 

on [0,1]. Thus we conclude that supg^t^i \Mt\ = Op(i). Next, we use the law of the iterated 
logarithm for continuous martingales. This can be put together from the Dambis-Dubins- 
Schwarz theorem (Karatzas and Shreve, 1991, Theorem 3.4.6) and the law of the iterated 
logarithm for the Wiener process (Karatzas and Shreve, 1991, Theorem 2.9.23). 


. \Mt\ , \Mt\ 

hm sup-^ ^ hm sup- :— = 

aj f‘X„duJ\og\og(a^ f'X^du) 


1 a.s., VA > 

’ 2 ’ 
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which means that the supremum on [l,oo] is finite a.s. (since the process in question has 
a.s. continuous trajectories). Now we note that 


a 


2A 


/g Xu du 


^ E(X„ 




a.s. 


Now the statement of the lemma is obtained straightforwardly since 

sup T^-^\Mt\ =max(sup sup T^-^\Mt\), 

o^tsgr i^tsgr 

and both terms have been shown to be Op(l). 

8.5 Lemma. Under the conditions of Theorem 5.1 we have 

9-6 = Op(T-i/2). 


□ 


Proof. 




-lrp-l/2 


-1 


^0,r Qj’Q I pQ 


-1 


+ dr,T — QtQ (1 ~ P)Q 


a 

b" 


The first factor converges almost surely, so we analyze 


J1-1/2 



a 


^0,r QfpQ 1 pQ 

b 

)\ 


= T-'l^dr + T-'!^ - QrQ~"pQ') 



The first term is Op(l) by (4.3). We need to show that the second term is also Op(l). For 
this, we can neglect the vector of the parameters, which are constant, so we investigate 

{Qr - pQtQ^'q') = T-^'" {Qr - E(QJ) + (E(o,) - tQ') 

-r-‘/"(p(Q^-E(QU)Q^"Qj 

- r-‘/" (p(E(Qy) - TQjQ^'Q j 
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The first and third factors have a finite variance at the limit, by Lemma 8.1. Therefore, 
by an application of Chebyshev’s inequality, we have that they are Op(l). The second and 
fourth terms are deterministic and 0(1) by (2.7). □ 


8.6 Lemma. Under the conditions of Theorem 5.1 we have 


lim lim sup P 

K^oo T^oo 


( sup 


ppT 

f-M (X,-E(X,))ds 

JpT-t 



0 . 


Proof. We use Lemma 8.2. We choose c(s) = s ^ and W = ^pT-s — E(^pr-s) with a = K 
and (3 = pT. The estimate on the probability in question is then 


K ^ j Var(W„) du + / ( / / Cov(Wtj, X„)dMdn | d |s 

IpT-K Jk \JpT-s JpT-s J 


^pT 


pT / ppT ppT 


(8.7) 


d 


-21 


ppT 

2 / s-2 

Jk 


ppT ppT 

Var(W,) / / Cov(X„,X^)dMdn 

JpT—sJpT—s 


1/2 


ds. 


Now we make use of (8.3) and (8.4) to show that 

r r Cov(W„,W^)dMdn ^ Var(Xo) T e-^^^+^^dudv 

JpT—sJpT—s JpT—sJpT—s 


ppT ppT 

+ (E(Xo) + ^ ps, 

J pT—s J pT—s 


for some positive constant p. We introduce A := supjgRVar(W) < oo, to continue the 
estimation started in (8.7): 


rp 

IK 


ppT 


K-^KX + 2 / Ts-^psds + 2 / ds. 


IK 


Clearly, as T ^ oo (and hence pT —)■ oo), and then K ^ oo, this expression tends to zero, 
which completes our proof. □ 

8.7 Lemma. Under the conditions of Theorem 5.1 we have, for any £ > 0, 

lim hmsupP( sup \t~^{MpT — MpT-t)\ > ^ ) =0. 

K^co T^oo \K^t!ipT J 


Proof. Let us take a backward partition of [0,pT] such that 0 = < tn-i < tn -2 < ... < 

ti < to = pT- For t G we have 


MpT - Mt 


MpT - 

1 

1 

+ 

pT — t 

pT - U 


pT - ti 
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Therefore, we have the following estimation: 

P( sup \t~^{MpT — MpT-t)\ > s\ = P( sup \{pT — t)~^{MpT — Mt)\ > e 

\Ki^t^pT J \0i^t^pT-K 

( 8 . 8 ) > 0 

+ f;p( sup [(pr-t.)-‘(M,-M,,^,)|>|V 

where i* = min{* : ti < pT — K}. Let us use this estimate with ti := pT — 2*“^ for 0 < i < n, 
so that n = Llog 2 pT\ and i* = Llog 2 iLj + 1. 

For the first term we can use the following lemma: 


8.8 Lemma. (Kokoszka and Leipus, 1998, Theorem 3.1) Let (Tn)neN be a sequence of 
random variables with finite second moments, and let {cn)neN be a sequence of nonnegative 
constants. Then, for any a > 0, 

) n—l k 

< E14+1 - 41E 

k=l *J=1 

n-1 / k \ F2 

+ 2E4+. iE(nti)E®wii) 

k=l \ / 

n—1 

+ 2E4+iE(!w-i)- 

k=0 


/ 

k 

P max 

\ l^k^n 

E^'i 

.?=i 


Let us set Yi := M^., - Mpx, and Yfc = ioi I < k ^ n - i* + I and 

Cfc = (pT —Let us note that due to the structure of the U, we have Ck = 
for A: ^ n — i* and < c„_ j*+i < Cn-i*. Consequently, we can use 


I 2 2| ^ 

Tfc+1 Cj^\ ^ 


Ir^ - I 

Tfc+1 ^^k+l\ 


3c 


2 

fc+1- 


Also, notice that 


) = E ( K. ) = E(M,,.„_, - M,t)- 

*J = 1 


. «=1 
rpT 


= a 


E(X„) du ^ cr^pipT - U+k-i), 


i*+k-i 
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with n = supjgji^ lE(Xt) < oo, and that similarly, 


IE(yfc+i) ^ crV(ii*+fc - ti*+k-i) = 


All in all, with Lemma 8.8, we can estimate the first term in (8.8) by 

n—i* + l n—i*+l 


k=l 


_ j “^(j^ji 'y ^ + 2(T^/i y ^ (i*+A:—1) ^2{**+^~2)+(i*+fc—l)^l/2 

k=l 

n—i*+l '' 

+2aV ^ 4-p*+fc-i)2h-+fc-2) 


k=l 


k=l 


k=l 


k=l 


^ ^ ( 3a V** XI + 2aV2”** + 2aV2"*‘ X ) = p^V2"**. 


This does not depend on n (hence, on T), and since i* —)■ oo as iL ^ oo, we have that the 
hrst term in (8.8) converges to zero as pT —)■ oo and then K —)■ oo. 

For the second term in (8.8) we will use Doob’s submartingale inequality (see, e.g., 
Karatzas and Shreve, 1991, Theorem 1.3.8. (i)) to the submartingales 


Nt^i := t e[0,ti-ti+i], i = 


e^{pT - tif 


for which clearly 

P ( sup I (pT - I > I ] = P ( sup Nt^i > 

The inequality states that 

r( N ■-> tiPLllil'] < _ 4E(M.. - 4gV(ti - 

4 y ^ - U)'^ - UY '' - UY 

Now, in our present setting, 

U - ti+i ^ {pT - T-i) - (pT - T) = 2*-i and (pT - Uf ^ 2^*-^ 

Thus, the second term in (8.8) can be estimated from above by 

9 9 n 9 9 OO 

y 2-*+3 ^ y 2-L 

4 ^ 4 

i=i* 4=0 


Again, clearly this does not depend on n (thus, T) and converges to zero as i* —?> oo (and 
thus, as K ^ oo). This suffices for our statement. □ 
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